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Attorney Docket No.: 052990 

AMENDMENTS TO THE CLAIMS 

This listing of claims replaces all prior versions of claims in the application. 
Listing of Claims: 

Claim 1 (Currently Amended) An image recognition system that recognizes motions of 
players of a sport playing between areas partitioned by an obstacle such as a net from a content of 
its on-air program, of its material video before broadcasted, or recorded by a recording media 
such as a VTR, and characterized by comprising 

a visual information obtaining part device that obtains visual information on which a 
motion of the player in at least one area during a match is shown from the content, 

an occlusion state determining part device that determines whether or not a used material 
such as a ball that moves between the areas included in the visual information obtained by the 
visual information obtaining part device and that is an object to count the score of the relevant 
sport is in a state being hidden by a predetermined object body, 

an impact time information specifying part device that specifies an impact time when the 
used material is hit based on an occlusion start time when the occlusion state determining part 
device determines that the used material changes its state from not being hidden by the object 
body to being hidden by the object and an occlusion release time when the occlusion state 
determining part device determines that the used material changes its state from being hidden by 
the object body to not being hidden by the object, 

a rule information storing part device that stores rule information to conduct the relevant 
sport, and 
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an image content recognizing part device that recognizes an image content including the motion 
of the player shown by the visual information based on the visual information obtained by the 
visual information obtaining part device , a position of the used material at the impact time 
specified by the impact time information specifying part device and the rule information stored in 
the rule information storing part device . 

Claim 2 (Currently Amended): The image recognition system described in claim 1, and 
characterized by that the occlusion state determining part device comprises a distance 
determining part device that determines whether or not the used material locates within a 
predetermined distance from the object body and an occlusion start and release time specifying 
part device that specifies a moment when the distance determining part device determines that 
the used material locates within the predetermined distance from the object body and the used 
material changes its state from not being hidden by the object body to being hidden by the object 
body as the occlusion start time and that specifies a moment when the distance determining part 
device determines that the used material locates within the predetermined distance from the 
object body and the used material changes its state from being hidden by the object body to not 
being hidden by the object body as the occlusion release time. 

Claim 3 (Previously Presented): The image recognition system described in claim 1, and 
characterized by that the impact time shown by t a > the occlusion start time shown by tO and the 
occlusion release time shown by tl have a relationship shown by the following expression 
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(Expression 1) 

(Expression 1) t a =a><tO+(l-a)xtl 
where coefficient a is O^a^ 1 

Claim 4 (Currently Amended): The image recognition system described in claim 1, and 
characterized by that the visual information obtaining part device comprises a domain element 
extracting part device that extracts used facilities information such as the obstacle like the net or 
a boundary line showing a boundary between the areas and outside the areas, player position 
information showing a position of the player and used material information showing the used 
material that moves between the areas and that becomes the object to count the score of the 
relevant sport from the visual information. 

Claim 5 (Original): The image recognition system described in claim 4, and 
characterized by that the player position information is position information showing a region 
including the player and a tool that the player always holds and uses during the match. 

Claim 6 (Currently Amended): The image recognition system described in claim 4, and 
characterized by that the domain element extracting part device extracts the player position 
information from the visual information based on the used facilities information extracted by the 
domain element extracting part device . 
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Claim 7 (Currently Amended): The image recognition system described in claim 4, and 
characterized by that the domain element extracting part device extracts the used material 
information from the visual information based on the used facilities information and the player 
position information extracted by the domain element extracting part device . 

Claim 8 (Previously Presented): The image recognition system described in claim 4, 
and characterized by that the used facilities information, the player position information, the used 
material information and the rule information are based on knowledge regarding a sport item to 
be a target to extract the image. 

Claim 9 (Currently Amended): The image recognition system described in claim 1, and 
characterized by comprising an audio information obtaining part device that obtains audio 
information synchronous with the visual information, such as an impact sound generating at a 
moment when the used material such as the ball that moves between the areas and that is an 
object to count the score of the relevant sport is hit from the content, wherein the impact time 
information specifying part device specifies the impact time based on a combination of the 
occlusion start time and the occlusion release time and the audio information obtained by the 
audio information obtaining part device . 
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Claim 10 (Original): The image recognition system described in claim 9, and 
characterized by that the impact time information specifying part specifies a time when the audio 
information shows a value bigger than a predetermined level as the impact time. 

Claim 11 (Currently Amended): The image recognition system described in claim 9, and 
characterized by that the audio information obtaining part device comprises a filtering part 
device that passes a predetermined frequency band and the audio information is the information 
that has passed through the filtering part device . 

Claim 12 (Currently Amended): The image recognition system described in claim 11, and 
characterized by the filtering part device consists of a band-pass filter. 

Claim 13 (Currently Amended): The image recognition system described in claim 9, and 
characterized by that the impact time information specifying part device specifies the impact time 
based on an impact sound candidate data having a predetermined time including the impact 
sound extracted from the audio information. 

Claim 14 (Currently Amended): The image recognition system described in claim 9, and 
characterized by that multiple pieces of impact sound candidate data are extracted from the audio 
information so that an impact sound candidate data at one time and an impact sound candidate 
data at its subsequent time have a time that overlaps each other and the impact time information 
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specifying part device specifies the impact time based on the multiple pieces of the impact sound 
candidate data. 

Claim 15 (Original): The image recognition system described in claim 14, and 
characterized by that each of the multiple pieces of the impact sound candidate data is arranged 
to have an identical data length and the multiple pieces of the impact sound candidate data are 
arranged to be extracted from the audio information at intervals of a certain period. 

Claim 16 (Currently Amended): The image recognition system described in claim 9, and 
characterized by comprising an impact sound pattern information storing part device that stores 
impact sound pattern information that is a patternized sound change due to a state under which 
the used material is hit by the tool such as a racket that the player always holds and uses during 
the match, wherein the impact time information specifying part device specifies the impact time 
based on the impact sound pattern information stored in the impact sound pattern information 
storing pat device and the audio information. 

Claim 17 (Currently Amended): An image recognition system that recognizes motions of 
players of a sport playing between areas partitioned by an obstacle such as a net from a content of 
its on-air program, of its material video before broadcasted, or recorded by a recording media 
such as a VTR, and characterized by comprising 
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a visual information obtaining part device that obtains visual information on which a 
motion of the player in at least one area during a match is shown from the content, 

an occlusion state determining part device that determines whether or not a used material 
such as a ball that moves between the areas included in the visual information obtained by the 
visual information obtaining part device and that is an object to count the score of the relevant 
sport is in a state being hidden by a predetermined object body, 

an impact time information specifying part device that specifies an impact time when the 
used material is hit based on an occlusion start time when the occlusion state determining part 
device determines that the used material changes its state from not being hidden by the object 
body to being hidden by the object and an occlusion release time when the occlusion state 
determining part device determines that the used material changes its state from being hidden by 
the object body to not being hidden by the object, and 

an image content recognizing part device that recognizes an image content including the 
motion of the player shown by the visual information based on the visual information obtained 
by the visual information obtaining part device and a position of the used material at the impact 
time specified by the impact time information specifying part device . 

Claim 18 (Currently Amended): The image recognition system described in claim 17, and 
characterized by comprising an audio information obtaining part device that obtains audio 
information synchronous with the visual information, such as an impact sound generating at a 
time when the used material such as the ball that moves between the areas and that is an object to 
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count the score of the relevant sport is hit from the content, and the impact time information 
specifying part device specifies the impact time based on a combination of the occlusion start 
time and the occlusion release time and the audio information obtained by the audio information 
obtaining part device . 

Claim 19 (Currently Amended): An image recognition program stored in a computer 
readable medium that is a program activating an image recognition system that recognizes 
motions of players of a sport playing between areas partitioned by an obstacle such as a net from 
a content of its on-air program, of its material video before broadcasted, or recorded by a 
recording media such as a VTR by operating a computer, and characterized by making the 
computer function as 

a visual information obtaining means that obtains visual information on which a motion 
of the player in at least one area during a match is shown from the content, 
an occlusion state determining means that determines whether or not a used material such as a 
ball that moves between the areas included in the visual information obtained by the visual 
information obtaining means and that is an object to count the score of the relevant sport is in a 
state being hidden by a predetermined object body, 

an impact time information specifying means that specifies an impact time when the used 
material is hit based on an occlusion start time when the occlusion state determining means 
determines that the used material changes its state from not being hidden by the object body to 
being hidden by the object and an occlusion release time when the occlusion state determining 
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means determines that the used material changes its state from being hidden by the object body to 
not being hidden by the object, 

a rule information storing means that stores rule information to conduct the relevant sport, 

and 

an image content recognizing means that recognizes an image content including the 
motion of the player shown by the visual information based on the visual information obtained 
by the visual information obtaining means, a position of the used material at the impact time 
specified by the impact time information specifying means and the rule information stored in the 
rule information storing means. 

Claim 20 (Currently Amended): An image recognition program stored in a computer 
readable medium that is a program activating an image recognition system that recognizes 
motions of players of a sport playing between areas partitioned by an obstacle such as a net from 
content of its on-air program, of its material video before broadcasted, or recorded by a recording 
media such as a VTR by operating a computer, and characterized by making the computer to 
function as 

a visual information obtaining means that obtains visual information on which a motion 
of the player in at least one area during a match is shown from the content, 

an occlusion state determining means that determines whether or not a used material such 
as a ball that moves between the areas included in the visual information obtained by the visual 
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information obtaining means and that is an object to count the score of the relevant sport is in a 
state being hidden by a predetermined object body, 

an impact time information specifying means that specifies an impact time when the used 
material is hit based on an occlusion start time when the occlusion state determining means 
determines that the used material changes its state from not being hidden by the object body to 
being hidden by the object and an occlusion release time when the occlusion state determining 
means determines that the used material changes its state from being hidden by the object body to 
not being hidden by the object, and 

an image content recognizing means that recognizes an image content including the 
motion of the player shown by the visual information based on the visual information obtained 
by the visual information obtaining means and a position of the used material at the impact time 
specified by the impact time information specifying means. 



